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foulsysaly au ey Gay 


Gammon is a computer program which plays Backgammon. It 
was developed to investigate a concept of strategy as an integrating 
and driving force in the play of the game. A strategy is defined and 
implemented as a set of tactics where each tactic is a specific feature 
of play. Moves are generated and evaluated on the basis of the degree 
to which they accomplish the objectives of the tactics making up the 
current strategy. Strategies are selected and changed during the 
course of a game by heuristic analysis of the current game situation. 
Deductive learning mechanisms are employed to improve the program's 


performance, against both human and virtual machine opponents. 
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Lelio DU CTLION 


Pe PURPOSE 

This thesis describes an investigation into the use of strategies 
ina game-playing computer program. The vehicle for the study was 
Gammon, a program which plays Backgammon. 

The research was motivated by four related factors. 

1. The study of game strategies had not been a major 
objective of previous game-playing programs. 

2. Because Backgammon play is characterized by the 
existence of several traditional and well-defined styles or strategies, 
it was especially suited to the study. 

3. Experiments in machine learning could focus not only 
on the play of a given individual strategy, but on the process of 
selecting a strategy as well. 

4. To the author's knowledge Backgammon had not yet been 


programmed for play on a computer. 


Bb GENERAL CHARACTERISTICS 
Gammon has these principal characteristics: 

1, The concept of strategy is central to the organization ~ 
and operation of the program. The program analyzes the game 
situation, chooses an appropriate strategy, and selects the move 
most consistent with the definition of that strategy. 

2. The basic logic of the program is that of goal-fulfillment. 
otrategies are defined operationally as sets of tactics or game 


features. Each tactic has an objective, the achievement of which 





is the sole purpose of the mechanism which generates and evaluates 
moves. Unlike many other game-playing programs, Gammon does 
not construct and searcha game tree. 

3. Gammon assesses the consequences of proposed moves 
by incorporating into its evaluation process an estimate of the prob- 
able net worth of men captured or threatened. 

4. Gammon improves its performance through a learning 
mechanism whereby a human ''tutor'' evaluates and supplements the 
responses of the program during the course of play. 

5. The program operates in either an interactive or ean 
environment, and requires approximately 100K bytes on an IBM 


360/67 (TSS). It was written in PL/I. 


C. SUMMARY OF RESULTS AND CONCLUSIONS 

In general, the validity of the strategy concept was verified by 
the performance of the program. 

The strategies employed by the program were designed to emulate 
the traditional Backgammon styles of play. The play of Gammon 
generally conformed to these traditional styles, but lacked consist- 
ency. The uneveness of play was particularly noticeable when the 
learning mechanism was employed intensively at one stage ofa 
game, without being balanced at other stages. 

Perhaps the most serious weakness observed was the frequent 
inability of the program to capitalize on potentially highly favorable 
situations or to avoid potentially highly dangerous ones. These 
critical situations were usually short-range in nature, that is, 


existent only over a span of a few moves. 








Thus, the strategy concept developed for Gammon was generally 
satisfactory in terms of the long-range or overall character of its 
play, but generally inadequate with respect to recognizing and ex- 
ploiting critical short-range objectives. 

Suggested improvements include refining the existing mechanisms 
for generating and evaluating moves, defining new tactics, and 
providing the capability to identify, store, and retrieve generalized 
critical board situations for use as temporary objectives. 

The processing time required by Gammon was reasonable. The 
average response time at the terminal for a move cycle was less than 
a minute. The CPU time required for a complete game in the batch 


mode was approximately one minute. 





Te, BACKGROUND 


Artificial intelligence research is concerned with constructing 
computer programs which exhibit behavior that is called "intelligent 
behavior'' when observed in human beings. Within this field, game 
playing has been both a favorite and prominent endeavor. 

Game playing has many fascinating aspects to the 
researcher. Effectively, it provides a direct contest 
between man's wit and machine wit. Ona more 
serious level, game situations provide problem envir- 
onments which are relatively highly regular and well 
defined, but which afford sufficient complexity in 
solution generation so that intelligence and symbolic 
reasoning skills play a crucial role. In short, game 
environments are very useful task environments for 


studying the nature and structure of complex problem- 
solving processes [Ref. 1]. 


10 date, programs have been written for a variety of games in- 
cluding chess, checkers, Go, Nim, Kalah, and bridge. Common to 
many of these programs are certain principal features. 

All programs have some kind of scheme for evaluating or measur- 
ing the ''goodness" of the move, play, or board configuration under 
consideration. Perhaps the most widely used technique is that of the 


linear scoring polynomial, which has the form 


S= C)X, 35 Cox, Tt... tC, X,- 


The X's usually represent the value of some feature of play such as 
control of certain key board positions, the capture of an enemy piece, 
or the presence of a certain geometrical configuration of pieces. The 
C's are weighting coefficients which usually indicate the desirability 


of that particular feature. 





Another common device is the game tree. All two-person zero- 
sum games (of which chess, checkers, and backgammon are examples) 
can be conceived of in terms of a tree structure which represents all 
possible sequences of moves. The main problem is one of assigning 
values to the nodes of the tree and of searching fora ''best'' path. A 
common technique is to explore the tree to certain depth, use the 
scoring technique to assign values at these points and then "back up" 
the score. That is, work the scores of the highest valued moves up 
through the tree to the present position. The well known checkers 
program of Samuel uses this technique [Ref. 2]. 

The complete game tree is almost always much too large to be 
stored or manipulated in any present day computer. Thus the require- 
ments of practicality have given rise to sets of powerful heuristics 
for ''pruning'' the tree, or in some way reducing the dimensions of 
the solution space to be searched. It is the nature of heuristics that 
they are not always successful, but the necessity for having them has 
resulted in some of the most inventive and brilliant programming. 

Another basis of organizing a game-playing program is the use 
of goals, features of the game which it is desirable to attain during 
the course of play. The chess program of Newell, Shaw, and Simon 
uses this approach [Ref. 3]. Their program uses a set of goals which 
are conceptual units of chess, for example, King safety, material 
balance, and control of the center. For each goal there are three 
routines associated with it: (1) a move generator that finds moves 
positively related to carrying out the goal; (2) a procedure for making 
a static evaluation of any position with respect to the goal; (3) an 


analysis move generator that explores the game tree in order to 


determine the possible consequences of a move. 





Many game-playing programs, representing as they doa well 
defined subsystem of thought, are developed to explore the capabilities 
of the machine to exhibit learning behavior. Generally, learning 
mechanisms can be grouped into three types: deductive, inductive, 
and discovery. In the deductive method the programmer fixes the 
weights--the coefficients of the scoring polynomial--and the character- 
istics to be measured --the X's. Inthe inductive approach the program- 
mer fixes the characteristics, but the coefficients are generated and 
adjusted at runtimes. Both the characteristics and weights are 
generated at run time using the discovery method. The Newell-Shaw- 
Simon program is deductive, while Samuel's program is inductive. 
BOGART [Ref. 4], a more generalized game player and problem 
solver, uses the discovery method when playing Tic-tac-toe by analyz- 
ing and generalizing on geometrical configurations of the board. 

A prominent feature of many games, but one that has been absent 
from virtually all game playing programs, is the concept of strategy. 

Samuel, in the second report [Ref. 5] on his checkers program, 
States: 

The chief defect of the program in the recent past, 
according to several checker masters, seems to have 
been its failure to maintain any fixed strategy during 
play. The good player during his own play will note 
that a given board situation is favorable to him in 
some one respect and perhaps unfavorable in some 
second respect, and he will follow some fairly con- 
sistent policy for several moves ina row. In general 
he will try to maintain his advantage and at the same 
time to overcome the unfavorable aspect. In doing 
this he may more or less ignore other secondary 
properties which, under different circumstances, 
might themselves be dominant. The program, as 
described, treats each board situation as a new problem. 


However, in the same report Samuel suggests an approach to 


strategy not unlike that developed for Gammon. Samuel recognized 
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that the linear polynomial method of scoring moves suffered the dis- 
advantage of assumed linear relationships between measured character- 
istics and the desirability of a move. In an attempt to correct this 
weakness Samuel employed what he calls "signature tables.'' These 
tables, in fact, are a technique for measuring the contribution toa 
move score of the interaction among members of sets of features. 
According to Samuel: 

A possible mechanism for introducing this kind of 

strategic planning is provided by the signature 

table procedure and by the plausibility analysis. 

It is only necessary to view tne different signature 

types as different strategic elements and to alter 

the relative weights assigned to the different signature 

types asa result of the plausibility analysis of the 

initial board situation. For this to be effective, 

some care must be given to the groupings of the 

parameters into the signature types so that these 

signature types tend to correspond to recognizable 

strategic concepts. Fortunately, the same initial- 

level grouping of parameters that is indicated by 

interdependency considerations seems to be reason- 

able in terms of strategies. We conclude that it is 


quite feasible to introduce the concept of strategy in 
this restricted way. 


Samuel subsequently abandoned this ee, suggesting that the 
disappointing results were due to"... the ineffectual arrangement of 
terms inte usable strategic groups....'"' 

With this background in mind, the overall design of Gammon can 
be placed ina more clear perspective. First, the method of generating 
and evaluating moves in Gammon is clearly more similar to the ap- 
proach of Newell, Shaw, and Simon, than to the game tree technique. 
However, Gammon uses a set of features, i.e., a strategy, asa 
goal, and employs move generators and evaluators at the component 
level. The risk evaluator of Gammon performs a similar function as 
the analysis generators of Newell, Shaw, and Simon in assessing the 


consequences of a proposed move. 


ae) 





The concept of a strategy as a logical grouping of game features, 
as suggested by Samuel, is developed more fully in Gammon. In the 
latter, however, the intent is not to develop an improved scoring 
technique, but to give operational definitions to the styles of play or 
strategies traditional to the game of Backgammon. In Chapter IV this 
concept will be described in more detail, but at this point a brief look 


at the game of Backgammon is in order. 
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III. THE GAME OF BACKGAMMON 


Backgammon is one of the oldest of board games, having been 
known to the Greeks and Romans of ancient times and praised by 
Chaucer and Shakespears. It is still a popular pastime in the 
Mediterranean area. The game enjoyed a resurge of popularity in 
this country during the 1930's when certain variants of the game 
increased its attractiveness as a kind of parlor gambling game. A 
variant of the game, ''Acey-Deucey'"', remains popular inthe U. S. 
Navy. 

Belonging to the class of ''military'' board games, along with 
chess and checkers, Backgammon is a game of retreat. Opposing 
forces are deployed in the field with the objective being to move them 
safely through the counter-retreating enemy to one's "home"! and 
thence oft the board. 

The figure below depicts the board, the initial positions, and the 
direction of movement. 

The game is played ona board divided into two halves, or tables, 
by a eer nee Strip callea@ the bar. Extending from the sides 
nearest the players toward the center are alternately colored narrow 
triangles, or points, to and from which the men move. The points 
are usually referred to by number, each player's points numbered 
from 12 to 1 from his outer to inner table. Each player has. 15 men, 
usually white or red for one player and black for the other. A pair of 
dice completes the necessary equipment. 

A play is made in Backgammon by moving a man, or men, as 


many points as there are pips on the thrown dice. If doublets are 
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thrown, the player moves twice the number of points indicated. In 
playing a throw the number on each die is played separately, not the 
total as a single number. 

In moving a man around the boarda player cannot move a man to 
a point on which two or more of the mponent'smen are resting. Such 
a point is called a "held" or ''made" point. 

If a player moves to a point occupied by only one opponent (a 
single man is termed a "blot'') that man is called "hit'' and is taken 
out of play by placing it on the bar. On the opponent's next play, 
before he can move any other men, all of his men on the bar mast be 
brought back on the board by entering them in his opponent's inner table 
on the points corresponding to the dice roll. A man hit must thus 
start his journey all over again. 

The objective of the game is to move all of one's men around the 
board and into his inner table while at the same time impeding the 
progress of his opponent as muchas possible. Once all ofa player's 
men are in his inner table he begins the final operation, known as 
‘bearing off''. This consists of removing men from the inner table 
and off the board according to the throws of the dice. The first 
player to do this wins the game. 

A unique feature of Backgammon is the existence of several 
traditional seravenees or styles of play. 

1. The Position Game. This is perhaps the fundamental 
strategy of Backgammon. It is the cautious, conservative game in 
which one lets the opponent take the bold risks while you occupy key 
points, expose as few men as possible, bring up your rear-most 


men at every safe opportunity, and keep alert for advantageous 
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circumstances to switch to another strategy. Position is the strategy 
usually adopted for the early stages of the game. 

2. The Running Game. This style of play is more aggressive, 
in which the object is to get as many men "home", i.e., into one's 
own inner table as expeditiously as possible. One accepts a higher 
risk in this game, although it can nie be played defensively, with 
more concern for exposed men. This strategy is frequently adopted 
when one has an early advantage because of fortuitous dice rolls. It 
is also a common strategy for use near the end game when all or 
most of one's men have passed safely by the last opponent. 

3. The Blocking Game. The object of this game is to erect 
a block or ''side prime" of six consecutive points, thereby trapping 
the opponent's men infront. Ideally, the block is then advanced a 
point or two ata time, continuously impeding the progress of the 
opponent. The blocking strategy requires that the disposition of one's 
men make the construction of a block possible. Given these conditions 
the block is a powerful weapon, although it is more typically used 
when one is behind. 

4, The Back Game. This is the strategy of desparation, to 
be used only when one is far behind ina game. In some respects it 
is a special case of the blocking game, in that the object is to build a 
block in or near the opponent'sinner table, while continually hitting 
his blots whenever possible, and at the same time exposing any of 
your advanced men so that they may be hit and hence brought on the 
board near where the back block is being erected. It is avery dii- 
ficult game to carry off successfully but is sometimes the only 


Ze COUrSE. 
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5. Bearing Off. This is the end-game of Backgammon in which 
men are withdrawn from the board. Onder no threat of capture the 
object is to get as many men off the board with as few rolls of the 
dice as possible. If, however, the opponent has some deep runners 
or men still on the bar, the bearing off process must be balanced 
against the precaution of not exposing mento capture. Hence there 
are distinct offensive and defensive end-game strategies. 

References 6 through 8 contain complete descriptions of the 


rules and strategies of Backgammon. 
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[IV eee hoe TIONOh THE PROGRAM 


A. GENERAL 

As a computer program, Gammon has two significant character- 
istics: It is modular in design and operation, and the same set of 
modules can be used for either interactive or batch execution. 

The modular approach was adopted in order to be able to call 
one module from within several other modules. Moreover, because 
of the large size of the program, the ability to design, write, compile, 
test, and execute it as logically separate entities was a practical as 
well as organizational necessity. 

Each module is described in detail in Appendix C, but it is ap- 
propriate to list here the major functions performed by the program 
as a whole. These functions are: 

1. To implement the various commands, options, and moves 
entened at the terminal. 

2. To administer the game by calling the other modules in 
the appropriate sequence, andto gather and rearrange data for the 
arguments. This is the ''main program" function. 

3. To set up the initial board and initialize game statistics 
and variables. 

4. To generate random numbers for use as the dice roll. 

5. To select the strategy for the next move. 

6. To provide a mechanism by which other modules can 
determine, for any roll of the dice, the points on the board to which, 


and from which, legal moves may be made. 
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7. To generate moves for the selected strategy and record 
them in a coded form. 
8. To decode the moves and place them in a conventional 
list. 
9. To evaluate the moves in the list and assign scores. 
10. To locate the move with the highest score and rearrange 
the list for further evaluation if necessary. 
ll. To implement the selected move and update the game 
board and the cumulative statistics. 
IZ. Lo print the resulting board. 
13. To adjust coefficients after a move has been graded by 
tne terminal user. 
14. To perform a variety of nee functions such as displaying 
or searching the list of moves, and printing or storing the tactics and 


coefficients. 


B. BOARD REPRESENTATION 

Representing the Backgammon board internally is a relatively 
simple matter. Unlike many games which utilize a two-dimensional 
board, Backgammon pieces move in one dimension only. Hence, the 
board can be represented as a linear array of size 24, one element 
for each point on the board. Since only one player may occupy a 
given point the number of pieces on any point can be represented by 
an integer, positive for White pieces, negative for Black. The points 
are numbered from 1 to 24 beginning in White's inner table, and 
continuing through his outer table and Black's outer and inner tables. 


While this method of numbering is reversed in the usual mathematical 


ly, 





sense, it conforms to the customary notation of Backgammon 
btenature. 

In portraying the Backgammon board at the terminal or on 
printed output the following conventions were adopted: 

1. The board is represented with the two halves joined in 
linear fashion with White's inner table and point 24 to the left. White 
moves from right to left, and Black from left to right. 

Z. White pieces are represented by an ''O", Black pieces 
by an ''X"'. To reduce the physical size of the board a maximum of 
two O's or X's are displayed on any one point. Any men in excess of 
two are denoted by an integer placed immediately above that point. 

The figure below is the Gammon display corresponding to the 


starting board setup shown in Figure 1, Section IIL. 
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Figure 2. Program Representation of the Backgammon Board 

3. Moves are represented on this board by specifying 
the numbers of the points from and to which the men move. A 
"half move'' is a move of a single man the number of points shown 
on one die, suchas 12-17 fora die showing 5. A ''single move" 
involves either one man in two steps, one for each die, or two 
men, each moving the number of points shown ona single die. 
This is the normal move. For example, fora roll of 5-2 the 


move 12-17, 17-19 denotes the move of one man from the 12-point 
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to the 17-point, and thence from the 17-point to the 19-point. A 
"double move" involves four die units since a throw of doubles is 
given twice the amount shown. For a throw of 4-4 for example, a 
double move might be denoted as 12-16, 12-16, 12-16, 16-20, which 
represents the move of three men from the 12-point to the 16-point 
and one man up four points from the 16-point. 

From White's standpoint, a move which brings a man on the 
board from the bar is of the form 0 - P; and a bearing off move as 
P-25, where P is the number of some point on the board. The role 
of the 0-point and the 25-point as extensions of the board are reversed, 


of course, for Black. 


Ceeeew vie STA TiS eicS 
Several numeric quantities which describe significant features of 
the state and progress of the game are maintained by the program. 
Separate sets are maintained for White and Black. 
These statistics are: 
1, The current strategy employed by each player. 
2. The cumulative dice count. This is a measure of the 
'"resources'! allocated to each player. 
3. The advance of each player. If we think of the initial 
board configuration as representing a zero position, then moving a 
man forward 6 points is an advance of 6. The advance, then, isa 
measure of a player's pregress. By subtracting Black's advance 
from White's advance we get the relative point advantage for White. 
This latter number is a key quantity in determining which strategy 
to select. Note that the advance and cumulative dice count usually 


become unequal as the game progresses because of men being hit 
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and sent back, or being prevented from moving by a block. 

4. Bear-off Distance. This is a measure of the total number 
of man-points a player must advance before he can begin the end- 
game or bearing off phase. From the starting board positions, the 
bear-off distance is 77. Since the average dice roll provides an 
advance of approximately 8 1/3 points (doublets give twice as many 
points as the dice count), the bearing off phase can be reached on 
average of 9-10 moves, provided no blots are hit. 

5. Overlap. This is a measure of the advance required to 
get one's rearmost men safely past the opponent's rearmost men. It 
is computed by multiplying the distance (in points) separating the 
rearmost men by the total number of such men. Overlap is another 
key factor in strategy selection. 

6. The number of home points held. This is a simple tally 
of the number of White home points held by White, and Black home 
points held by Black. 

7. The number of opponent's home points held. This isa 
count of White home points held by Black, and vice verse. 

8. The number of men left to bear off. The sum ofa player's 
pieces left on the board and those onthe bar. The first player to 
reduce this quantity to zero wins the game. 

9. The location of rearmost men. The point on which the 
Peaumoct I1en are resting. 

10. The location of the next-to-rearmost men. 
11. The number of men onthe bar. This number of men 


must all be brought into play before any other move can be made. 
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12. The head of the block. The point on which the forward- 
most men of the block are resting. | | 

13. The tail of the block. The point on which the rearward- 
most men of the block are resting, or the rear location of the blocking 
region. 

14. The block potential. This number has the form XYZZ, 
where X is the number of points a player holds in his blocking area, 
Y is number of points the opponent holds in the same area, and ZZ is 
a measure of the likelihood of improving the block by filling in the 
remaining gaps. A perfect block -- six consectively held points -- 
would have a block potential of 6000, that is, 6 points held, none feta 
by the opponent, and no opportunity for improvement. The blocking 
potential is used in deciding whether or not to adopt a blocking 


strategy. 


D, Phe TACTICS .OF GAMMON 

Tactics are the fundamental logical elements of Gammon. Each 
tactic corresponds to some feature or minor objective of the game. 
Examples of tactics are to advance the rearmost men, to cover blots, 
to occupy certain key points, to get men into the oe table as soon 
as possible, to construct a block, and to hit the opponent's blots. 

The process within Gammon which selects the next move is solely 
concerned with generating legal moves which tend to accomplish the 
objectives of these tactics, and with evaluating moves by measuring 
the dégree to which they achieve the tactical objective. Consider, for 
example, tactic number 32 which is to occupy the opponent's 7-point. 
The move generator for tactic 32 finds all legal moves using the 


current dice roll which result in one or more men moving to the 
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opponent's 7-point. The move evaluator for tactic 32 examines every 
move generated and awards points based on the extent to which the 
move improves the occupation of the 7-point. If the point is already 
held by you, no points are awarded because the move does not add 
anything to the existing situation. If, say, the point is unoccupied, 
moving two men there is awarded more points than moving a single 
man terthe point. 

Gammon has the capability to accommodate 50 tactics, of which 
approximately 45 are active. Some of these are Boolean combinations 
of others, for example, enter and hit, or enter and cover. Saiane 
tactics have operational similarities. For example, tactics 30-39 are 
all concerned with occupying key points. 

A complete list of all tactics with brief descriptions of their 


objectives is contained in Appendix A. 


E. THE STRATEGIES OF GAMMON 

Recall that the conventional strategies in Backgammon are position, 
running, blocking, back, and bearing off. One of the main design 
objectives of Gammon was to impart the main characteristics of these 
strategies to sequences of moves, rather than to consider each move 
separately. 

The mechanism developed to implement this concept was to define 
the strategies as a finite sets of tactics. Each tactic in turn, has an 
objective which acts as a goal for generating and evaluating moves. 

The operational definition of the strategies was arrived at by 
analysis of the conventional game strategies given in Backgammon 


literature. The first step was to identify as many tactics as possible, 
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regardless of the particular style of play with which they were associa- 
ted. The second step was to group the tactics in such a way as to 
describe in operational terms the various strategies. 

Seven such strategies were ultimately defined. They correspond’ 
closely to the traditional strategies. For the running and bearing off 
strategies, however, two distinct sets of tactics were defined, one 
describing an offensive style, i.e., the absence of any threat of 
capture from the opponent, anda defensive counterpart, i.e., the 
same basic style of play, but conducted in the see of enemy 


threat of capture. The seven strategies of Gammon are: 


Bearing off-offensive 
Bearing off-defensive 


1. Position 

2. Running-offensive 
3. Running-defensive 
4. Blocking 

5. Back 

6. 

re 


Each "machine" player in Gammon is provided with a 7 x 30 array 
containing the identification numbers of the tactics comprising his 
Strate aes. 

Within a set, the same tactic may be a member of more than one 
strategy. For example, tactic 32, Occupy Opponent's 7-point might 
be a member of the Position strategy, the Blocking strategy, and the 
Defensive Running strategy. However, analysis of the literature in- 
dicates that occupying the 7-point is very important in the blocking 
game, moderately important in the position game, and of little im- 
portance in the running game. 

To enable the program to make this kind of distinction, each 
"machine" player is also provided witha 7 x 30 array of coefficients. 


The magnitude of each coefficient indicates the relative importance 
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of the corresponding tactic. These coefficients are used as multi- 
plication factors in the evaluation process. The SeeNEaKO® ior a 
tactic awards points independently of the strategy. However, this 
partial score is multiplied by the coefficient from the appropriate 
strategy and thereby imparts the relative importance of that tactic to 
the player's current strategy. 

In defining the strategies, each tactic was placed in one of three 
priority classes. The initial coefficient load assigned a value of 4 to 
those in the highest priority level, 2 in the intermediate level, and 1 
in the lower level. As learning progressed these values changed 
considerably. Gammon was provided with the capability to rearrange 
the tactic numbers and coefficients within its strategies so as to 
place the highest valued ones first. As will be pointed out later, this 
partitioning of the strategy sets was also a useful operational device. 

Appendix B contains a listing of a representative set of strategy 


definitions in terms of the component tactics. 


Povo, Pe Ce NE RATION AND EVALUATION 

The process of generating and evaluating moves is the heart of 
Gammon. Two of the program modules are directly involved in this 
process and three others indirectly. 

The information required at the beginning of the cycle is the 
current game board, the dice roll, the identity of the player who is 
to move (the active player) and his strategy. The logic of the cycle 
is basically as follows: 

1, Retrieve the first tactic identification number from 


priority level 1 of the appropriate strategy set of the active player. 
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2.» Generate moves for this tactic. 

3. Repeat the process for all other tactics in the first 
Brien evel, 

4, If no moves have been generated for first level tactics, 
repeat the process for level two tactics, etc. 

5. Evaluate each move on the list using the tactics of level 
one, multiply the partial score of each tactic by the corresponding 
coefficient and accumulate the total score for the move. 

6. If the total score of one of the moves is greater than the 
score of the other moves by some predetermined margin then elec 
that move. Otherwise resolve the tie bv evaluating those moves with 
nearly equal scores using the tactics at level two, and so on. 

Thus the more heavily weighted tactics within a strategy definition 
will tend to dominate the selection process at both the generation and 
evaluation stages. This "pruning" of the conceptual game tree was 
designed primarily to reduce the processing time in order to improve 
the response time in the interactive version. Inthe batch mode, where 
processing time is less critical, this device is overridden by con- 
tinuing to generate moves until some predetermined maximum number 
of moves is reached. The criteria for "'tied'' scores can be adjusted 
at the terminal, providing another means of varying the number of 
moves considered. 

In assigning partial scores, the gradations of ''goodness"' were 
kept within the range of 0-1. Interim scores were assigned ona 64 
point scale (e.g., 16 points for a fair move, 32 for good, 64 for 


perfect), divided by 64, and then multiplied by the coefficient. 
All moves are generated and evaluated as if White were to play. 


On Black's move, the board is converted prior to the cycle and 
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re~-translated on return. 


G. RISK EVALUATION 

As noted earlier, Gammon does not normally explore the game 
tree beyond the first level. However, in the event that a proposed 
move leaves a man exposed, the program assesses the consequences 
by assigning a risk value to that move. The logic in this assessment 
is essentially as follows. 

1. Locate the exposed man and determine if it has captured 
an opponent as a result of ae move. If so, award positive points 
depending on the value of the captured man (his advance). Moreover, 
if it is probable that the captured man will be prevented from coming 
back on the board because of positions which you block, then award 
additional points. 

2. Scan ahead on the board and locate enemy pieces which 
may hit your blot on the next play. Subtract points based on the 
advance of your man, the number of threatening men, and the prob- 
ability that these men will be able to hit. These calculations are 
simplified by the fact that probability tables exist in Backgammon 
literature for (1) entering the board as a function of the number of 
open points and (2) hitting a blot as a function of its distance away and 
the number of intervening closed points. 

3. Repeat the first two steps for each exposed man on the 
board, and accumulate the values. 

The risk value assigned to a move may be either positive (e.g., 
when a man has been captured and little threat of a return hit exists) 


or negative. 
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Mechanically, risk is treated as a tactic. It has a coefficient 


which reflects the importance of risk to the particular strategy. 


HeopRATEGY SELECTION 

The determination of the strategy to be used is determined by 
analysis of two sets of numbers: the game statistics, described 
above, and a set of parameters which delimit the transition points 
from one strategy to another, in terms of the relative point advantage. 

Typical advice from Backgammon experts is to use the back game 
only when one is "far'' behind, and the blocking game when one is 
'slightly'' behind. The program uses the parameters to define these 
points. For example, the transition parameter for the back game 
is - 50, i.e., the program will not select the back strategy unless 
the player is at least 50 points behind. Meeting the parameter criteria 
alone is usually not sufficient to justify a transition. 

Another key criterion is the other player's strategy. With rare 
exceptions, a back game and a blocking game are countered bya 
running game unless the opportunity for blocking is high. 

Selection of bearing off strategies is relatively straightforward, 
since the rules of the game define exactly when bearing off is per- 
mitted. The choice of defensive or offensive styles is simply a 
matter of whether a threat exists. 

These and other considerations are embodied in the set of 
decision rules which the program uses to selecta strategy. If the 
transition tests fail, the program retains the previous strategy, in 
order to prevent unnecessary jumping back and forth between 


strategies. 
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Two other factors need mention here. First, each player is per- 
mitted to 'know'' the other's strategy. This is largely justified on 
the basis that in actual play, the strategy of the other person, if he 
has one, is usually apparent. 

The second, and perhaps more valid weakness of the strategy 
selection process is that the selection is made before the moves are 
generated, hence consideration of the next move as a factor in the 
selection is disregarded. The human player normally includes in his 
analysis an assessment of whether a suitable move exists to justify a 
choice. The decision to adopt a blocking game, for example, is not 


made unless a reasonably good blocking move can be made on the nex? 


play. 


io) Dobe rPROGCRAM MODULES 

The major functions performed by the program were identified 
earlier. In this section these functions are associated with the specific 
modules which accomplish them, and in the following section the 
general interrelationships among the modules is outlined. 

Detailed descriptions of the modules, their principal subroutines, 
and significant programming techniques are contained in Appendix C. 

Briefly, the modules and their major functions are as follows: 

1. GAMMON is the designated main program, but acts only 
as an interface between the terminal user and the rest of the program, 
accepting two-letter command codes and branching to the appropriate 
entry point in other modules. 

2. SETUP is activated only in the beginning of a game. It 


retrieves the desired board configuration, strategy and coefficient 


Sets from disk files, and initializes the game statistics. 
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3. ROLL generates the random integers used as the dice 
roll. 

4. MASK produces a bit array which identifies all positions 
on the current board which the active player may either move to or 
move from, using various configurations of moves with the current 
arce Tole 

5. MVGEN contains the move generators for each of the 
tactics. It refers to the array produced by MAWK to ensure that any 
move generated is legal. To avoid duplication, moves are uniquely 
encoded using bit strings, each of which records all generated moves 
of a certain type or geometrical profile. 

6. MVLIST decodes the bit strings encoded by MVGEN. The 
moves are translated into the customary notation and placedina 
conventional list. 

7. MVEVAL contains the evaluators for each tactic. In 
performing the evaluations of each move on the list, it implements 
each proposed move ona temporary board, analyzes the changes, 
and measures the degree to which the objective of each appropriate 
tactic is achievedasa result of the change. Risk analysis is also 
performed by this module. 

8. MVPICK places the move with the largest score at the 
top of the list and rearranges the remaining list such that all moves 
whose scores are within a specified interval of the largest are placed 
next on the list. Those not qualifying are discarded. | 

9. MVIMP implements the move at the top of the list after 
the evaluation cycle is completed. It updates the current game board, 


the game statistics, and certain data used by other modules. 
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10. PUTI1 displays the updated board, the move and its score, 
the number of men on the bar, and the current strategies of each 
player. The Computer Output section of this report contains a com- 
plete game using the standard format. An abbreviated format is used 
in terminal play in order to reduce printing time. 

11. ADMIN is the most complex module. It performs the 
"main program" function, i.e., calls the other modules in the ap- 
propriate sequence, and arranges data for their use. Its subroutines 
determine the strategy to be used, check the legality of moves entered 
at the terminal, and execute most of the commands issued by the 
terminal user. ADMIN detects certain game situations which require 
a departure from the logic of the main cycle, suchas entering a 


single man from the bar, end-of-game, and no-moves. 


J. GENERAL PROGRAM FLOW AND LOGIC 

Having examined the concepts and components of Gammon, the 
general flow of the game can now be summarized. Figure 3 is a 
Flow chart of the overall logic of the program. The chart applies to 
a single batch game between two virtual machine opponents. 

Two branch points are noted on the chart aren require elabora- 
tion. In both cases a deviation from the normal flow of the program 
is required in order to handle a unique situation. Each case requires 
a single move to be constructed from two separately generated half- 
Moves deatirs: Special branch point is DO ENTER. This part of 
the program deals with the situation where a player has a single man 
on the bar which must be brought into play immediately. The first 
half-move, if available, brings the man on the board. An interim 


updating is then accomplished. The next step is to generate the 
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second half of the move using the other available die. 

The second special case is performed in the DO SQUEEZE 
branch. This situation occurs when a player has a single man left 
to bring into the bearing-off area, and it is possible to do so using 
only one die. The first half-move attempts to squeeze this last 
runner into the bearing-off area. If this is successful, the strategy 
of the player is changed to bearing-off, and the board is partially 
updated. The second half-move is a normal bearing-off move using 
the other die. The two half-moves are then paired up and the entire 
move implemented in the usual manner. 

Gammon departs from the established rules of Backgammon in 
only one respect, the play of doublets. According to the rules, all 
four half-moves are accomplished as a single sequence. However, 
mechanisms to analyze and record all possible configurations of 
4-unit moves become extremely complex. Gammon compromises 
by implementing a doubles move in two single-move steps. On the 
first of the two, the risk evaluator is disenabled. The effect is to 
give the system a chance to accept a higher risk move on the first 
cycle, knowing that it will have an opportunity to make adjustments 


immediately afterward. 


K, LEARNING MECHANISMS 

The learning technique employed in Gammon was a relatively 
simple deductive mechanism. The coefficients used in the evaluation 
polynomial were initially loaded by the programmer and remained 
unchanged during run time, except upon command by the operator. 


The following devices were available to the human "tutor" in 


order to induce learning. 
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1. Following the selection of a move by the program, the 
tutor may assign a numerical grade to the move. The program re- 
peats the evaluation process and stores the partial scores for each 
tactic involved. A partial score is the product of the evaluation score 
for that tactic and the corresponding coefficient. Also accumulated 
are the sums of all positive partial scores and all negative partial 
scores. The second evaluation is carried through only as many 
priority levels as was the original process. 

The program then adjusts the coefficients of the tactics making up 
the current strategy using the following rules: 

Am Inecremental change, XWMLTA, is comaputed for the 
coefficient of each tactic which participated in the evaluation process. 

b. XDELTA is proportional to the magnitude of the assigned 
Mune ri1c Prade, 

c. XDELTA is proportional to the ratio of the partial score 
for that tactic to the partial sum having like sign. Thus, if a given 
tactic contributes twice as many positive points to the final move score 
as another tactic, the magnitude of the change in the first coefficient 
would be twice as large as the second. 

d. The sign of XDELTA is positive if the signs of the grade 
and the partial score are the same, negative if these signs are dif- 
ferent anMOnr example, af a move were given a prade of +3, the coef- 
ficients of all tactics which helped make the total move score positive 
(i.e., their partial scores were positive) would be made Fie positive. 
The coefficients of those tactics eich contributed negatively to this 


''sood'' move would be decreased. 
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e. The signs of coefficients are kept positive. The continuous 
adverse contribution of a tactic will result in its coefficient becoming 
increasingly small. 

2. A second training device is to carry out the same kind of 
process described above using: (a) moves generated by the program, 
but not selected because of an insufficient score, or (b) moves not 
generated by the program but supplied by the tutor. After the program 
has completed its move, all or part of the list of moves which it con- 
sidered may be displayed, along with the move scores. The tutor may 
select one or more of these moves to be re-evaluated and graded as 
described above. Moreover, if the program failed to generate moves 
which the tutor thinks are particularly good or bad, examples of these 
may be entered, evaluated, and graded. 

Following a training session the tutor may invoke routines which 
will display the current or old sets of tactics or coefficients, or store 
the current sets on disk files for future use. It is also possible to 
perform a sort operation on the current coefficient sets, placing the 
largest coefficients in the first priority level. In this process, the 


corresponding tactic numbers are similarly rearranged. 


Peo > OF PLAY AND PROGRAM OPTIONS 

Gammon is a versatile program with respect to the number and 
types of different operations which may be performed. Some of these 
have been mentioned in the course of the foregoing discussion. How- 
ever, a consolidated summary of these options will better reveal this 
scope. 

1. The program may operate either interactively or ina batch 


mode. 
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Zeeelinethesbaveneenviaronment, three different types of runs may 
be specified. The first is a standard eit game, the second isa 
series of two games with both players being provided identical dice 
rolls, and the third is a series of five games, each of which is con- 
ducted with identical rolls. The technique of using identical rolls 
for both players during a play-response cycle is to reduce inequities 
introduced by the random dice rolls. 

Spee nopramenouLrpuc Inay be directed to a disk file for printing 
at a later time, or may default to the terminal or the system printer. 

4. Inthe terminal version, the user may request the program to 
evaluate his moves, providing another means of judging the system's 
performance. 

5. Atrace option may be specified. With the trace, the progress 
of the program throughout all the modules is provided in detail, in- 
cluding abbreviated boards and partial scores for every move 
evaluated. 

6. Any of several starting board configurations may be specified. 

¢. Whe userinay alte ry during play at the terminal, the trace 
option, the strategy of either player, or the value of the criteria for 
"tied'' moves. A game may also be restarted, without terminating 
Exe cwlon. 

8. The user may have displayed all or a specified number of 
the moves in the current move list. He may also enter a move, have 
the program determine whether it is on its current list, and have the 
score displayed. 

9. The user may have displayed the current or original set of 


tactics and coefficients. This data may also be directed toa disk file. 
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10. The user may grade the move selected by the program, any 
move on the current list, or any move the user chooses to supply. 

11. The current set of coefficients may be exchanged between 
the two players on command. 

12. The current board configuration, or sets of tactics or coef- 


ficients may be stored on disk on command. 


M. ENVIRONMENT 

The program was initially developed using the Cambridge Monitor 
System (CMS) on the IBM 360/67 at the Naval Postgraduate Seno 
Computer Facility. In the midst of the debugging process CMS was 
replaced by IBM's Time Sharing System (TSS) and the program was 
converted. Considerable difficulty and loss of time accompanied this 
conversion. 

Gammon consists of approximately 2900 PL/I statements and is 
compiled by the TSS version 5 PL/I compiler into a total of about 
100 K bytes of program and storage. In its final form the program 
comprises 11 modules ranging in size from 25-970 PL/I statements. 

In the interactive mode, the time required by the program to 
complete one play varied from 5 seconds to 2 minutes depending on 
the number of tasks active in the TSS system and the number of 
possible moves needing evaluation. The average response time at 
the terminal for the program to select its next move was approximately 
30 seconds. Inthe batch mode, the average CPU time required to 


play one complete game was approximately one minute. 
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V. RESULTS AND CONCLUSIONS 


me PUAY OF STRATEGIES 

In general, Gammon meets its design objective with respect to 
its play of the individual strategies. Moreover, the game strategies 
as played by Gammon bore a reasonable resemblance to the traditional 
Backgammon game styles they were intended to emulate. Least 
acceptable was the play of the blocking and back strategies. To some 
extent this was anticipated bécause the successful construction and 
advance of a block requires considerable skill, even for human 
players. 

The play of most strategies was uneven or spotty. The program 
would frequently select a move consistent with the overall character- 
istics of the strategy, but quite unsuited for the particular situation. 

At times, the move selected seemed overly conservative with 
respect to the general intent of the current strategy. On other oc- 
casions the move was overly aggressive. When faced with a block, 
for example, Gammon fails to capitalize on opportunities to move 
through or over the block. 

The risk evaluator was adequate provided the major consequences 
of a move were restricted to the move and the immediate reply. 
Moves selected because of favorable immediate consequences (e.g., 
a large positive point award resulting from a capture) often had quite 


unfavorable consequences two moves later. 


io een GY or LECTION 


The mechanism for strategy selection performed at an acceptable 
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level. However, since this mechanism only required the application 
of pre-defined decision rules it cannot claim any Scere distinction. 
Because the logic of the process favored retention of the current 
strategy (unless the tests for transition were met) the program oc- 
casionally persisted with a strategy beyond the point suggested by 
common sense. A case in point is blocking. The program usually 
continued with the blocking strategy even though the conditions for 
maintaining an effective block no longer existed. This defect could 


be corrected by refining the decision rules. 


C, LEARNING 

A thorough evaluation of the learning mechanisms was not possible 
because of time constraints. 

Based on the training that could be accomplished, the learning 
mechanism did improve the program's performance. In particular, 
the consistency of play was improved, probably because a better 
balance was achieved among the coefficients. Little improvement 
was noted with regard to the program's ability to exploit unusually 
good opportunities, or to protect itself properly when presented with 
an unusually high threat situation. 

The learning process, because it requires human participation, 
is quite slow. The time to complete a reasonable session exceeded 
one hour. Moreover, the frequent occurrence of system failures 
lowered the probability of successfully completing any extended 
training session. 

Repeated gradings after one play would sometimes disproportion- 


ately alter a small number of coefficients. Asa result, these in- 


flated values would unfavorably influence the evaluation at a later 
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stage of play. Thus, the training session needed to be balanced 
throughout the course ofa game. As noted above, it was difficult 


to accomplish such prolonged sessions. 


D. MAJOR AREAS OF DIFFICULTY 

In the development stages, the most difficult design problems 
centered around the techniques for determining the legality of moves, 
the encoding and decoding procedures, the provisions for handling 
entering and bearing off moves, and the compatibility and coordina- 
tion among the modules. 

Whenever possible, modules were fully tested independently of 
the others. However, many of the major program functions could 
not be adequately checked out until all of the Serie were brought 
together. The main difficulties that arose at this time centered 
around the various special situations requiring deviations from the 
logic of the main cycle. Half-move operations, occurrences of no 
moves, doublets, and simultaneous provisions for the various modes 


of play and options were major complications. 


KE. MAJOR STRENGTHS AND WEAKNESSES 

The Bn strengths of the program may be summarized as 
follows: 

1. In general, the program met its design objectives with 
respect to the play of the individual strategies. 

2. The programs play an interesting, but not particularly 
skillful game of Backgammon. 


3. The response time is small enough to be able to complete a 


game in one setting. When the number of users in the system is 
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low, the response time approaches that of human play. 

4. The program is quite versatile, permitting the terminal user 
to select from a wide range of options, and alter conditions during 
execution. 

The major weaknesses are: 

1. In retrospect, some parts of the program are unnecessarily 
complex. Some techniques were developed to minimize problems 
which turned out to be of less importance than originally thought. 

2. The program does not react properly to unusual temporary 
game situations requiring departures from standard styles of play. 

3. The play of the strategies tended to be uneven and spotty. 

4. The lack of a dynamic learning mechanism which could 
operate in batch mode seriously impedes the rate of learning. This 
deficiency stems from the fact the program has no standard against 
which to judge the adequacies of its strategies, except the human 


tutor. 


EF. SUGGESTED IMPROVEMENTS 

To alleviate some of the deficiencies noted above the following 
are considered to have the potential to produce detectable improve - 
ments with a reasonable investment of effort. 

l. The logic of the move generators could be refined. At present, 
a move generator essentially generates all possible moves which 
might satisfy the objective of that tactic. When many tactics are 
involved, the final list actually becomes non-selective. Another way 
of looking at it is that since there are so many tactics, practically 


every legal move is bound to satisfy one of them. Nevertheless, 


most of the generators could be made more specific, both with respect 
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to (a) producing moves with higher positive potential, and (b) screening 
out moves with higher negative potential, or those more clearly un- 
suited for the particular situation. 

2. The evaluators could undergo a similar refinement, if only 
to eliminate inconsistencies introduced because of the author's lack 
of Backgammon expertise. 

3. The program could be provided with the capability to alter 
dynamically the composition of its strategy sets. Deletions could be 
accomplished by the program, based on coefficients which become 
increasingly small. New tactics could be selected at random froma 
list provided by the programmer, or by a mechanism such as that 
described below. 

4. The program needs a capability for accommodating short range 
objectives. The current strategies are general in nature and are not 
well suited for exploitation of more pressing short range goals. Many 
of these situations could be described as generalized board configura- 
tions. They might have the form of templates which could be matched 
against the present or proposed board in order to determine whether 
or not the situation exists. If a match were made, subsequent genera- 
tion and evaluation procedures would attempt to satisfy the objective. 
However, providing the program with the capability to recognize and 


describe these short range objectives would not be a simple task. 


G. CONCLUSIONS 
The main conclusion of the study is that the validity of the strategy 
concept developed with Gammon was generally verified by the perfor- 


mance of the program. The play of Gammon using its strategies took 
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on the overall characteristics of the corresponding Backgammon 
styles of play. However, the concept needs to be modified in order 
to better recognize and accomplish short range objectives, particular- 


ly high-opportunity or high-threat situations. 
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ViogeN BitQa RING OFF DERENSIVELY, MAKE 
PGE WOrerOINTSs BOTH EVEN OR ODD 
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20 


oe 
Zo 


23 


24-29 
30 
3] 
SIZ 
33-39 
40 
4l 
42 
43 
44 
45 
46 
47 
48 
49 


50 


WHEN BEARING OFF, MOVE.TO LOWER 
POINTS 


COVER BLOTS 
DistRIbBULTE MEN IN OUTER TABLES 


BRING MEN INTO SAFE AREA BEHIND 
OPPONENTS REARMOST MEN 


UNUSED 

SECUPY CEPONENTI'S 5 POMT 
CCGWPY CeEPONeNT'S 4 POINT 
OCGHEY OPPONENT S 7 POINT 
OCeCereY YOUR 3-9 POINTs 

HIT ALL BLOTS 

Mit eb EBOts IN-O@UTER TABLES 

Pit BtOrsS IN OPPONENT'S INNER TABLE 
HIT BLOTS IN YOUR INNER TABLE 
UNUSED 

ENTER ON LOW POINTS 

ENTER ANDEAIT 

Pere AND pO NOL AIT 

ENTER AND COVER 

ENTER AND EXPOSE 


RISK VALUE 
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Pee ENIX C 
DESCRIPTIONS OF THE PROGRAM MODULES 


1. Gammon 
This module is the designated main program. However, in 

the batch version, upon receiving control it immediately passes it to 
ADMIN, which actually performs the main program function. In the 
interactive version control is passed back to GAMMON after each 
move or aftea cemtain types oferrors. The principal function of 
GAMMON is to accept commands from the operator and branch to the 
appropriate point. Several two-character command codes may be 


issued at the terminal. The purpose of the commands are summarized 


below. 
GO -- continue the game. 
XX -- stop the game 
RE -- restart the game from the beginning. 
GR -- grade a move. 
TR -- change the trace option. 
CS -- changea player's strategy. 
CD -- change the quantity ''Delta'' which defines the 


range within which evaluated move scores 
are considered equivalent. 


EV -- enter a move of the operator's choice, have 
it evaluated and graded. 

Gk -- generate a move for some other strategy. 

DI -- display the present or old set of tactics or 
eoetiicients . 

SO -- sort the present sets of tactics into descending 
order according to the corresponding 
Coeilicienrs. 

LO -- locate the given move in the list of moves ome 
display its score. 

LI -- display all or portions of the list of generated 
moves. 

SW -- exchange the strategy and coefficient sets 
between the two players. 

ST -- store the present strategy and coefficient 


sets in disk files. 
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(Spoil Gs a 

This module is called only at the beginning of a game. It receives 
as arguments the file codes of the initial board configuration and the 
strategy and coefficient sets of the players. It reads in this data and 
initializes the game statistics. It also reads inthe tables containing 
the probabilities of hit and entry, as well as a table containing recom- 


mended opening moves. 


Soe ROLL 

ROLL returns a pair of integers on the interval (1,6). After 
generating these numbers, which serve as the dice roll, it passes 
them back such that the first die is greater than or equal to the second. 
ROLL is initially called with a positive odd integer SEED. Thereafter, 
it is called with an argument of 0. The series of pseudo-random 


numbers may be reproduced by providing the same seed. 


4. MASK 

The function of this module is to eae a reference by which 
other modules can determine whether or not a legal move can be made 
either to or from a given point, MASK requires as Te the 
current game board and dice roll (Dl, D2). In addition to these argu- 
ments, MASK is provided two bit strings of length 24. Each bit 
position corresponds toa point on the board. One string, TO STR, 
has a 1 in each position corresponding to a point on the board which is 
not held by an opponent. Thus it records every position to which the 
active player may legally move, regardless of the dice roll. The 
second string, FR_ STR, contains a 1 in those positions corresponding 


tO points on the board where the active player has men, i.e., positions 
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from which the active player may move, regardless of the dice roll. 
MASK then proceeds to construct a bit array indicating the legal to 
and from positions femithe currentedree roll. The criteria for»moving 
a man up D1 points from point P is that bit Pof FR_ STR =1 and that 
bit (P +Dljof TO_STR=1. This is done forall four possible con- 
figurations of moves involving a single man; (1) moving D1 points; 
(2) moving D2 points; (3) moving D1 points and thence moving D2 
points (a D1-D2 "'bounce"); and (4) a D2-D1 bounce. The TO and 
FROM arrays have dimensions 4 x 24 where the columns correspond 
to the points on the board and the rows indicate the type of mee. 

The construction of the arrays is accomplished by performing 
sequences of shift operations (in units of Dl and D2) and Boolean AND 
operations. | 

Suppose that a generator for a tactic needs to know whether a 
man can be moved toa certain point on the board. By examining the 
appropriate column of the TO matrix, it can determine not only 


whether any legal moves exist, but all possible forms of such moves. 


5. MVGEN 

This module contains the generators for the tactics. The general 
logic of the move generation process was discussed above. Here, the 
method by which moves are recorded will be described. 

One approach to recording moves would be to generate all moves, 
record them in the X-Y, W-Z notation and then analyze the list to 
remove duplicates. This method, however, would envolve consider- 
able processing time just for searching. The same can be said for 
the method of searching for duplicates after each single move was 


generated. To minimize this problem, Gammon records its generated 
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moves in coded bit strings such that duplicate moves simply set the 
same bits equal to 1. After the generation process is completed, the 
bit strings are decoded into the conventional X-Y, W-Z notation. 

The coding process requires a total of 17 bit strings, seven of 
length 24 to record all possible configurations of normal single 
moves, eight of length 6 to record all possible configuration of bearing 
off moves, and two of length 2 to record entering moves. 

'Normal'' moves have seven possible configurations. Their 
descriptions and the names of the strings used to record them are: 


1. SH1 - move a single man from point P to point 
Pr ph (single hep on Dl’). 


ZL teoce = vavsimele hop.on DZ. 


3. DH - moving two men ona throw oe doubles from 
Demmitet toma Org tet) ), 


Ale - a Dl-DZ bounce. 
5. BZ) - a D2-D1 bounce. 


6. CNV - a converging move, i.e., one in which men 
trem different points anove to the Same point. 


% FRK - a forking move, i.e., one in which two men 

from the same position move to two different points. 

A last, and usually quite large, class of moves are those in- 
volving all combinations of single hops, i.e., each single hop recorded 
in SHI paired with each single hop recorded in SH2. These combina- 
tions are implicit in the SH] and SH2 strings and are combined when 
the strings are decoded. 

MVGEN uses three subroutines to set the proper bits in these 
strings. 

Each has two arguments -- a point on the board, and the number 


of die units, 1 or 2, available as resources to accomplish the move. 
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The subroutines are (1) MVTO, which encodes all moves resulting in 
a man or men being placed on the specified point; (2) MVFM, which 
encodes all moves resulting in a man or men moving from the specified 
point, and (3) MVHIT, which encodes all moves resulting in hitting an 
exposed enemy piece located at the specified point. 

Usually, the generator for a tactic performs a preliminary 
analysis to determine the points on the board which should be involved 


in the move, and then calls the appropriate subroutines. 


6. MVLIST 

The function of this module is to decode the bit strings, translating 
the moves into conventional notation, and placing the moves ina list. 
MVLIST requires as arguments the encoded bit strings, the dice roll, 
and the availability number (1 or 2) which indicates whether to decode 
only half-moves or regular single moves. MVLIST proceeds through 
each bit string, noting the location of 1's and performing the translation. 

Suppose, for example, that bit 20 of FRK (fork move) were equal 
to l. Then, assuming a dice roll of 5-2, the move 20-15, 20-18 
would be placed in the list. Note that all moves are treated as if 
White were to move, hence the movement from higher to smaller 
point numbers. 

The move list is a 50 x 4 array with each row corresponding to a 
different move, and the four columns indicating the points of the 
board. 

In decoding the single hop strings, MVLIST forms all possible 
pair-wise combinations after first eliminating those which forma 


move already encoded as another type. 
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Co vv AL 

This module evaluates each of the re in the current move list 
and assigns points (plus or negative) based on the degree to which the 
move succeeds (or fails) to accomplish the objectives of the tactics 
which define the active player's current strategy. After evaluating 
each tactic it multiplies the partial score by the corresponding coef- 
ficient and accumulates the score until the entire process for that 
move is completed. It then proceeds to the next move. 

In making the evaluation, MVEVAL constructs a temporary game 
board which incorporates the results of the move under evaluation. 
In many of its assessments it compares the old and new boards to 
determine change as a result of the move. MVEVAL performs its 
evaluations one priority level ata time. If further evaluations are 
required it répeats the process at the next level for those moves still 
in contention. 

Recall that in the terminal version the human ''tutor"’ can assign 
a grade to the selected move. In order to eee its coefficients the 
program needs to know the partial scores for each tactic evaluated. 
However, it was considered wasteful of storage to aon all of these 
scores for all moves. Hence, whena move is givena grade, MVEVAL 
repeats its evaluation process, at which time it saves all of its partial 
scores for the move, as well as accumulating the sums of all positive 
and negative partial scores. The use of these special sums will be 


discussed later. 


8. MVPICK 


Following the evaluation of the list of moves, MVPICK locates 


the move with the maximum score and places it at the top of the list. 
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Immediately below this move are placed all moves whose scores are 
within distance DELTA from the highest-scored move. The remainder 
of the list is discarded. By making DELTA large we carry over more 
moves from one priority-level evaluation to the next, thus reducing 
the possibility that an excellent move will be eliminated from further 
consideration only because it scored poorly at one priority level. 
On the other hand, by making DELTA small, we quickly reduce the 
size of the list, thereby conserving processing time, and in the case 
of the interactive version, improving the response time. 

If, at the end of three evaluation cycles (one for each priority 
level) there is more than one move on the list, the first move is 


selecered for implementation. 


9. MVIMP 

Implementing the selected move is the function of this module. If 
the active player is Black it translates the move from the White-notation 
in which it was provided into the proper terms for Black. It then up- 
dates the game board by adding and subtracting men from the appropri- 
ate points. It also performs checks to ensure that the move is legal. 

It then proceeds to update the game statistics, revising the cumula- 
tive dice count and advance, relocating the rearmost men, etc. 

Finally, it updates the bit strings used by MASK. 

In the process of initializing the game before play begins, MVIMP 
may be involked by SETUP in the event that the initial board is other 
than the standard starting configuration, for example, a training board 
for bearing-off situations. MVIMP then initializes the game statistics 
by analyzing the board, reading data, or prompting the user to supply 


needed information. 
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Fosse Ud | 

This modules performs the function of writing the resulting board 
following implementation of the move. 

In the terminal version the board format is abbreviated in order’ 
to reduce the printing time. This was especially critical using TSS 
because the PL/I output introduces an unacceptably long delay at the 
end of each printed line. 

In the batch mode, the boards may either be directed to SYSPRINT, 
the normal print channel, or to a disk file data set in the user's 
library. 

Under TSS, a game can be initiated at the terminal as if it were 
a batch game and run to completion with the output directed to the 
private file. This file can then be printed off-line, reducing the turn- 
around time to a few minutes. 

A sample of a complete batch mode game is included in the 


Computer Output section of this report. 


11, ADMIN 

Left for last is the discussion of ADMIN, the module which is the 
largest aaa most complex. It embodies the main logic of the flow and 
control of the game and, except in name, is the main program. It 
makes the tests necessary to determine the state and progress of the 
game, gathers data together for use by the other modules, and issues 
calls to the other modules in the appropriate sequence. It contains 
several of the subroutines needed to perform the commands issued by 
the terminal user. 


The principle subroutines used by ADMIN are: 
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Soe toi R ff. 

This routine performs the Potten function of strategy 
selection. The major considerations in this process were discussed 
in Section IV. H. 

Peo Cire CcK 

The purpose of CHECK is to determine whether a move 
entered at the terminal is legal. If not, it prompts the user to re- 
enter the move, after displaying an appropriate diagnostic. 

c. STORE performs the function of writing the current board, 
strategy sets or coefficient sets on disk files. 

d. SWAP exchanges the current strategy sets of White and 
Black. 

e. DISPLAY prints the current strategy and coefficient sets of 
White or Black, along with the initial sets if desired. After a learning 
session in which the composition of those sets may change, it is useful 
to be able to display the changes for review and analysis. 

f. FIND 

It is often interesting to know whether or not a move other 
than the one finally implemented was generated and arent the evaluation 
score was. FIND performs this service. 

g. PUTLIST displays the entire move list, or a specified portion 
Otani 

h. SORTCT restructures a player's strategy and coefficient 
sets, placing the 10 largest coefficients and the corresponding tactic 
identification numbers in the first priority level of each strategy, the 


next 10 largest in the second level, and so on. 
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In addition to these subroutines, ADMIN contains the code which 
performs some of the other commands available to the user. Among 
these are adjusting coefficients as a result of a move being graded, 


evaluating and then grading in arbitrary move entered at the terminal 


during a training session, changing the trace option, and changing the 


DELTA value for move selection. 
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